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Abstract 

Objectives: The objective was to characterize service completion times by patient, clinical, temporal, 
and crowding factors for different phases of emergency care using quantile regression (QR). 
Methods: A retrospective cohort study was conducted on 1-year visit data from four academic emergency 
departments (EDs; JV = 48,896-58,316). From each ED's clinical information system, the authors extracted 
electronic service information (date and time of registration; bed placement, initial contact with physician, 
disposition decision, ED discharge, and disposition status; inpatient medicine bed occupancy rate); patient 
demographics (age, sex, insurance status, and mode of arrival); and clinical characteristics (acuity level and 
chief complaint) and then used the service information to calculate patients' waiting room time, treatment 
time, and boarding time, as well as the ED occupancy rate. The 10th, 50th, and 90th percentiles of each 
phase of care were estimated as a function of patient, clinical, temporal, and crowding factors using multi- 
variate QR. Accuracy of models was assessed by comparing observed and predicted service completion 
times and the proportion of observations that fell below the predicted 10th, 50th, and 90th percentiles. 
Results: At the 90th percentile, patients experienced long waiting room times (105-222 minutes), treat- 
ment times (393-616 minutes), and boarding times (381-1,228 minutes) across the EDs. We observed a 
strong interaction effect between acuity level and temporal factors (i.e., time of day and day of week) on 
waiting room time at all four sites. Acuity level 3 patients waited the longest across the four sites, and 
their waiting room times were most influenced by temporal factors compared to other acuity level 
patients. Acuity level and chief complaint were important predictors of all phases of care, and there was 
a significant interaction effect between acuity and chief complaint. Patients with a psychiatric problem 
experienced the longest treatment times, regardless of acuity level. Patients who presented with an 
injury did not wait as long for an ED or inpatient bed. Temporal factors were strong predictors of ser- 
vice completion time, particularly waiting room time. Mode of arrival was the only patient characteristic 
that substantially affected waiting room time and treatment time. Patients who arrived by ambulance 
had shorter wait times but longer treatment times compared to those who did not arrive by ambulance. 
There was close agreement between observed and predicted service completion times at the 10th, 50th, 
and 90th percentile distributions across the four EDs. 

Conclusions: Service completion times varied significantly across the four academic EDs. QR proved to 
be a useful method for estimating the service completion experience of not only typical ED patients, but 
also the experience of those who waited much shorter or longer. Building accurate models of ED service 
completion times is a critical first step needed to identify barriers to patient flow, begin the process of 
reengineering the system to reduce variability, and improve the timeliness of care provided. 
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Service completion times are a hallmark of service 
industries such as telecommunication, transpor- 
tation, and food and beverage sectors. In the 
emergency department (ED), waiting room time, treat- 
ment time, and boarding time are major phases of emer- 
gency care. Many EDs consider these service completion 
times measures of ED and hospital efficiency and moni- 
tor them to identify delays in care. Few investigators 
have developed models that characterize the completion 
times of different phases of emergency care. Asaro et al. 1 
used multivariate linear regression techniques to esti- 
mate ED waiting room time, treatment time, and board- 
ing time for patients who were admitted or discharged 
from the main ED or urgent care area. Similarly, 
McCarthy et al. 2 applied discrete-time survival analysis 
to evaluate the effect of crowding on the different phases 
of ED care. Both studies estimated the influence of 
various patient, temporal, and system factors on the 
mean or median completion times for different phases of 
emergency care. However, the distribution of ED length 
of stay (LOS) is highly positively skewed; that is, the 
deviations are much greater above the median than 
below. Focusing only on what happens on average, or in 
the middle, may provide an incomplete picture of the 
substantial variation that can exist among ED patients. 
To fully understand the LOS experience for all patients 
requires an analysis of the middle as well as both tails of 
the distribution. 

The purpose of this study was to characterize service 
completion times at four academic EDs using quantile 
regression (QR). QR offers a richer inference than other 
approaches because the LOS experience can be 
described at any percentile of the distribution. In this 
study, we used QR to develop models that accurately 
predict the 10th, 50th, and 90th percentiles of ED wait- 
ing room time, treatment time, and boarding time. We 
chose these particular percentiles of the distribution 
because in addition to characterizing a typical ED LOS 
experience (i.e., 50th percentile), we wanted to under- 
stand the experience of patients treated among the fast- 



est (10th percentile) and among the slowest (90th 
percentile). We based the QR models on patient demo- 
graphic, clinical, temporal, and crowding factors avail- 
able at triage so that in the future, the model estimates 
could be provided in real time to patients at the end of 
the triage process so that they would have a realistic 
expectation of how long it would take to complete 
different phases of their emergency care. 

METHODS 



Study Design 

This study relied on a retrospective cohort design that 
included all visits to each of four EDs during a 1-year 
period. We extracted service time data as well as 
patient and clinical information that were collected dur- 
ing triage or registration from the clinical information 
systems of each ED. We used QR to estimate the 10th, 
50th, and 90th percentiles for each phase of care. 
Because a detailed description of the study setting, 
selection of participants, and data collection procedures 
is available elsewhere, 2 only a brief summary of these 
topics follows. The study was reviewed and approved 
by the institutional review board at each site. 

Study Setting and Population 

The four study EDs are each part of tertiary care, aca- 
demic medical facilities with Level I trauma centers. 
The annual ED volumes at each site range from 50,000 
to 62,000 (see Table 1). However, the EDs differ sub- 
stantially in other ways such as ED bed capacity (26 to 
41 beds in main ED); inpatient medicine bed capacity, 
which includes all beds assigned to the divisions within 
the department of medicine at each academic site 
(range of 224 to 461 beds); existence of an observation 
unit (two of the four EDs); separate pediatric ED (three 
of the four EDs); dedicated laboratory (one of the four 
EDs); and whether boarders, defined as admitted ED 
patients waiting for a hospital bed, are managed by 
emergency physicians (EPs; two of the four EDs). There 



Table 1 

Description of Study Sites 



Facility Characteristics 


Site A 


Site B 


Site C 


Site D 


Annual ED volume 


57,691 


56,832 


50,824 


61,187 


Bed capacity 










Main ED 


32 


27 


41 


26 


Fast track 


7 


5 


4 


10 


Observation 


14 


16 


0 


0 


Inpatient medicine 


224 


287 


461 


246 


Median staffing (IQR) 










Doctors per hour 


3 (1-4) 


3 (2-3) 


3 (2-4) 


2 (1-2) 


Residents per hour 


4 (4-5) 


3 (2-3) 


4 (4-5) 


4 (4-4) 


Nurses per hour 


15 (14-17) 


21 (18-22) 


14 (12-15) 


10 (8-11) 


Hourly staffing/bed 


0.45 (0.42-0.47) 


0.54 (0.49-0.60) 


0.51 (0.45-0.53) 


0.50 (0.47-0.53) 


Hourly staffing/patient 


0.52 (0.45-0.62) 


0.56 (0.47-0.68) 


0.58 (0.48-0.74) 


0.43 (0.35-0.54) 


EPs care for ED boarders 


Yes 


No 


No 


Yes 


Median hourly occupancy rat 










% (IQR) 










ED 


86 (70-102) 


98 (78-121) 


86 (65-105) 


116 (89-143) 


Inpatient medicine beds 


83 (77-87) 


90 (86-93) 


78 (75-80) 


83 (77-87) 


IQR = interquartile range. 
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was also significant variation among the sites in terms 
of staffing, particularly nurse staffing (median range 
10-21). The median hourly ED occupancy rate (range 
86%-116%) and inpatient medicine bed occupancy rate 
(range 78%-90%) also demonstrated considerable vari- 
ability across the four sites. 

The patient populations of the study EDs differ sub- 
stantially on a few key characteristics. Site A treats a 
higher proportion of uninsured (37%) compared to the 
other three sites (range 5%-21%). Site D treats a 
higher percentage (45%) of low-acuity patients (i.e., 
Levels 4 and 5 according to the Emergency Severity 
Index [ESI]) compared to the other sites (range 14%- 
25%). The hospital admission rate varies substantially 
by site (range 19%-30%). Other patient characteristics 
are fairly similar across the sites, including age (range 
21%-29% > 55 years), female sex (range 52%-55%), 
percent who arrive by ambulance (range 20%-23%), 
frequency of presenting chief complaints, and arrival 
times. 2 

All 235,928 visits to the four EDs (range 56,345-62,590 
visits per ED) during a 1-year period (October 1, 2006, to 
September 30, 2007, for three sites and October 1, 2005, 
to September 30, 2006, for one site) were eligible for 
inclusion. We excluded 5,986 registration errors, 2,537 
visits transferred elsewhere and not treated in the study 
EDs, 871 visits with multiple missing time or invalid dis- 
charge times, 7,775 visits from patients who left without 
being seen, 2,313 visits from patients who left against 
medical advice, and 407 ED deaths. This resulted in a 
final sample size of 216,039 ED visits across the four sites 
(range 48,896-58,316 visits per ED). 

Data Collection and Processing 

From the clinical information system at each ED, we 
extracted the following electronic information: 1) date 
and time of registration; 2) date and time of bed place- 
ment; 3) date and time of initial contact with physician 
or midlevel provider (if available); 4) date and time of 
disposition decision as measured by electronic bed 
request; 5) date and time of ED discharge or transfer to 
an inpatient ward if admitted; 6) disposition status; 
7) demographic characteristics (age, sex, and insurance 
status); 8) acuity level; 9) mode of arrival; and 10) chief 
complaint. Each of the study EDs has a different 
electronic clinical information system. However, the 
data are documented in a similar way, which facilitated 
analysis across the four sites. 

Based on the service data above, we divided ED LOS 
into three phases: 1) waiting room time, defined as time 
from ED registration to ED bed placement; 2) treatment 
time, defined as time from ED bed placement until ED 
providers' disposition decision for admitted patients, and 
ED bed placement to ED discharge for discharged 
patients; and 3) boarding time, defined as time from ED 
providers' disposition decision to ED-hospital transfer 
for admitted patients. If ED bed placement time was 
missing, we used time to initial contact with an EP or 
midlevel provider. If patients who arrived by ambulance 
were taken directly to a treatment room, their waiting 
room time was zero and treatment time began at the time 
of bed placement. Seven percent of the ED visits were 
missing a data element needed to calculate the waiting 
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room time or boarding time (i.e., either bed placement 
time or disposition decision for admitted patients). 

All of the sites use the ESI to triage patients. The ESI 
is a five-level triage system that prioritizes patients 
based on their severity of illness and number of ED 
resources anticipated. 3-4 A score of 1 signifies patients 
of the highest acuity who require immediate, acute care 
resources, and a score of 5 is given to the lowest acuity 
patients who do not require urgent services. 

Each study ED documents the patient's reason for 
the ED visit using a standard list of chief complaints 
with the option of free text. To standardize the chief 
complaints across the four sites, we classified each 
chief complaint into one of 10 groups based on the 
Reason for Visit Classification System used by the 
National Hospital Ambulatory Medical Care Survey: 
1) injury; 2) digestive; 3) nervous system, eyes, or ears; 
4) cardiovascular; 5) psychiatric; 6) respiratory; 7) geni- 
tourinary; 8) skin; 9) musculoskeletal; and 10) general 
symptoms. 5 

Finally, we also used temporal factors (arrival day of 
week and arrival hour) and crowding measures to pre- 
dict the distribution of ED LOS. In the regression mod- 
els, we used indicator variables to represent each day 
of the week. To make the models more parsimonious, 
we represented the diurnal pattern of ED LOS with six 
sine and cosine parameters that were fitted from three 
cosine curves rather than using 24 indicator variables 
for each hour of the day. 6 We included the ED occu- 
pancy rate and the inpatient medicine bed occupancy 
rate at the time of each patient's arrival as our crowd- 
ing measures. The ED occupancy rate was calculated as 
the ratio of the total number of patients in the ED in a 
given hour divided by the total number of treatment 
spaces (excluding hallway locations) staffed during that 
hour. The hourly inpatient medicine bed occupancy rate 
was calculated as the ratio of the total number of inpa- 
tients occupying a bed assigned to one of the divisions 
of the department of medicine in a given hour divided 
by the total number of department of medicine beds. 
For three of the sites, the inpatient medicine bed occu- 
pancy rate was measured hourly during the entire 
study period, and at one site it was measured every 
6 hours. At this site, we linearly interpolated the rate 
between each measurement period. 2 

Data Analysis 

All analyses were conducted separately for each of the 
four sites. First, we used multiple imputation methodol- 
ogy to impute missing service completion times for 7% 
of the patients missing either bed placement time or 
admission decision time. Using patients with complete 
data, we predicted the fraction of waiting room time 
that was part of the waiting room time and treatment 
time for patients who had both using linear regression 
for an empirical logit transformation of the observed 
fraction. The key predictors in this model included 
patient (age, sex, insurance status, mode of arrival), 
clinical (chief complaint and acuity level), temporal 
(time of day and day of week), and crowding factors 
(ED occupancy rate and inpatient medicine bed rate). 
A similar model was estimated for the fraction of 
boarding time that was part of treatment time and 
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boarding time. Five imputed data sets were generated 
using these prediction equations. These multiple data 
sets were used to make valid inferences about the pre- 
dictors of the service completion times. 7,8 All results 
presented in this paper include the imputed data. 

Second, we estimated the probability densities of 
waiting room time, treatment time, and boarding time 
using kernal density estimation. 9 We displayed the dis- 
tribution of the service completion time on a log-trans- 
formed scale. All remaining analyses were performed 
using the original time values (not log transformed). 
Third, we compared the median service completion 
times by patient, clinical, temporal, and crowding char- 
acteristics. Fourth, we conducted stratified analyses to 
explore for possible interaction effects between the 
patient, clinical, temporal, and crowding factors on the 
different service completion outcomes. 

Fifth, we used multivariate QR to estimate the 10th, 
50th, and 90th percentiles of the waiting room time, 
treatment time, and boarding time distributions as a 
function of the patient, clinical, temporal, and crowding 
factors. All main effects were included in the final mod- 
els regardless of statistical significance, whereas inter- 
action terms were only retained if the p-value for the 
regression coefficient was <0.05. For each of the final 
QR models, we provide an estimate of the intercept, 
which is the estimated service completion time when all 
of the predictor variables in the model are equal to the 
reference level (see Results and tables for specification 
of reference levels). The regression coefficients for each 
predictor can be interpreted as the change in minutes 
in service completion time in a given quantile of the 
conditional distribution by a unit change (i.e., 10-year 
increase in age, male vs. female, acuity level 2 vs. 3, 
etc.) in the predictor variable. The total service comple- 
tion time associated with a specific predictor when it is 
not at the reference level can be estimated by adding 
the intercept estimate and the regression coefficient 
estimate for that variable together. The influence of the 
temporal factors on the outcomes are displayed by fig- 
ures, because the regression coefficients associated 
with the sine and cosine functions (time of day) are not 
directly interpretable. 

We were unable to model service completion times 
of acuity level 1 patients at sites B and D because the 
sample sizes were too small (367 and 38, respectively). 
At sites A and C, we were able to fit models that only 
included main effects. There was not sufficient sample 
size (2,699 and 1,421, respectively) to include all of the 
interaction terms, so we modeled acuity level 1 patients 
separately from acuity level 2-5 patients. Thus, the 
majority of the results presented in this article focus 
mainly on the results for the acuity level 2-5 patients at 
all of the sites. 

Finally, to evaluate the predictive accuracy of the 
QR models, we plotted the observed and predicted 
10th, 50th, and 90th percentile service completion 
times by day of week and time of day and compared 
how closely they matched each other. We also esti- 
mated the proportion of patients who fell below the 
predicted 10th, 50th, and 90th percentiles for different 
categories of the predictor variables (acuity levels, 
mode of arrival, etc.) and compared these to the nomi- 



nal 0.1, 0.5, and 0.9 values, respectively. In this com- 
parison, we used a 10-fold cross-validation so that the 
same data were not used to estimate and check the 
models. 10 All analyses were conducted in SAS version 
9.1 (SAS Institute, Cary, NC) and R version 2.7.0 
(http ://w w w . r-pr oj ect.org). 

RESULTS 

Figure 1 displays the probability distributions of wait- 
ing room time, treatment time, and boarding time on a 
logarithmic scale. Waiting room time remains highly 
positively skewed even on a logarithmic scale. The med- 
ian waiting room time ranged from 15 to 44 minutes 
across the four sites; the 90th percentile ranged from 
105 to 222 minutes. The 90th percentile treatment 
times ranged from 6.6 hours at site D to 10.5 hours 
at site B. At the 90th percentile, patients at site 
C waited two to three times longer for an inpatient bed 
(20.5 hours) compared to patients at the other sites 
(range 6.4-8.8 hours; data not shown). 

Tables 2-5 provide the site-specific QR estimates of 
the effect of different factors on the 10th, 50th, and 
90th percentiles of the three service completion times. 
The intercept values in Tables 2-5 are estimates from 
the QR models of the waiting room time, treatment 
time, and boarding time for a 40-year-old male, covered 
by commercial insurance, with an acuity level 3 general 
symptom chief complaint, who arrives without ambu- 
lance transport, at midnight on Saturday when the ED 
occupancy rate is at 100% and the inpatient medicine 
bed occupancy rate is 85%. In all three of these tables, 
the intercept values show that the difference in time 
between the 50th and 90th percentiles is much greater 
than the difference in the 10th and 50th percentiles. 

For waiting room time, the most influential patient 
characteristic was mode of arrival. At all of the study 
sites, patients who arrived by ambulance waited less 
time to be placed in a room (50th percentile range -18 
to -54 across the sites) compared to patients who did 
not arrive by ambulance. However, the effect of mode 
of arrival was much larger at the 50th and 90th percen- 
tiles compared to the 10th percentile. Chief complaint, 
acuity level, and the interaction of chief complaint and 
acuity level were all significant predictors of waiting 
room time. Patients who presented with injuries (50th 
percentile range -5 to -9 minutes across the sites), 
cardiovascular complaints (50th percentile range -3 to 
-11 minutes across the sites), or respiratory complaints 
(50th percentile range -2 to -8 minutes across the sites) 
were more quickly placed in a room compared to 
patients with a general symptom complaint across the 
four sites. Acuity level exerted the strongest effect on 
waiting room time, particularly at the 50th and 90th 
percentiles of the distribution. A 10% increase in the 
ED occupancy rate had a much bigger effect on waiting 
room time across the sites at the 50th (range 7 to 
12 minutes) and 90th (range 15 to 33 minutes) 
percentiles compared to the 10th percentile (range 0 to 
2 minutes). 

We observed a strong interaction effect between acu- 
ity level and temporal factors (i.e., time of day and 
day of week) on waiting room time at all four sites (see 
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Figure 1. Probability density distribution (smoothed histogram) of waiting room time, treatment time, and boarding time on a log 
scale by site. 



Table 2 

Change (Minutes) Associated With Patient, Clinical, and Crowding Factors on the 10th, 50th, and 90th Percentiles of Waiting Room 







Site A 




S 


te B 




Site C 




Site D 






in 


= 54,847 




(n = 


53,98 


) 


(n = 


48,896 


) (n 


= 58,316) 




Variables in Modelt 


10% 


50% 


90% 


10% 


50% 


90% 


10% 


50% 


90% 10% 


50% 


90% 


Intercept 


14 


95 


304 


5 


44 


153 


5 


36 


121 0 


50 


119 


Patient 
























Age (10-year increase) 


0 




5 


0 


0 


-1 


0 


-1 




-1 




Female (vs. male) 


1 






1 


4 


10 


1 








7 


























Medicaid 




7 




1 


3 




1 


2 


6 — 


9 


11 


Medicare 


2 


11 


33 










3 




8 


13 


Self-pay 


1 


8 


24 


2 


4 




2 






3 




Ambulance arrival (vs. not ambulance) -5 


-26 


-41 


-6 


-29 


-33 


-6 


-18 


-20 — 


-54 


-71 


Clinical 
























Chief complaint (vs. general) 


























-2 


-9 


-18 




-8 


-14 




-5 


-17 — 


-9 


-17 






9 




2 


6 


16 


2 


2 




3 


9 


Cardiovascular 






















-13 






-11 


48 


2 


-9 


-18 


2 










N ervo u s/eye/ea rs 








2 






2 


-2 


-12 — 


-7 


-9 


Respiratory 






















-13 


Genitourinary 




6 




2 


3 




2 




10 — 






Skin 
























Musculoskeletal 






15 


3 


3 




3 




-7 — 






Acuity (vs. level 3) J 
























Level 2 


-9 


-70 


-192 




-33 


-118 


0 


-15 


-38 — 


-33 


-33 


Level 4 or 5 




-40 


-101 




-17 


-58 


3 


-6 


-36 — 


-4 


-7 


Crowding 
























ED occupancy (10% increase) 


2 


12 


33 


0 


9 


27 


0 


7 


21 — 


8 


15 


Medicine bed (10% increase) 


0 


3 


8 


0 


-2 


-10 


0 


-2 


-14 — 






*Nonsignificant estimates (p > 0.05) 


re shown by a dash 


-). 


















tOther covariates in each regression 


model included time 


of day, day of week and 


nteraction of chief complaint 




of day x day of week x acuity, and tir 




day of week x 


mode of 




(only 


n site C) 










{Acuity level 1 patients not included 


n this mod 
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Table 3 

Change (Minutes) Associated With Patient, Clinical, and Crowding Factors on the 10th, 50th, and 90th Percentiles of Treatment Time* 







Site A 


























(n = 


54,847 






- 53 98 




. 


- 48 896 






- 58 316) 




Variables in Modelf 




10% 


50% 


90% 


10% 


50% 


90% 


10% 


50% 


90% 


10% 


50% 


90% 


Intercept 




24 


211 


657 


87 


242 


555 


63 


190 


459 


74 


216 


438 


Age (10-year increas 


e) 


1 


1 


13 


3 


7 


22 


— 


2 


15 


~ 1 


2 


7 


Female (vs. male) 




3 


7 


20 


5 


17 


29 


5 


6 


— 


5 


8 


12 


Insurance (vs. comn 


ercial) 


























Medicaid 








64 






21 


— 


7 


29 


6 


18 


54 


Medicare 








— 






-51 


— 


— 




9 


19 


36 


Self-pay 






— 






















Ambulance arrival ( 


/s. not ambulance) 10 


22 






















Clinical 




























Chief complaint (vs. 


general) 






























-6 


-65 






















Digestive 




11 




101 


- 




87 


27 


52 




13 


35 


69 


Cardiovascular 








— 


19 


29 


565 


19 


12 


72 


-12 


-20 


-53 






-16 
























Nervous/eye/ears 




























Respiratory 






48 


-67 


-17 


-54 


-74 


_ 


-22 


-68 


-13 


-45 


-82 


Genitourinary 




12 




-127 






-43 


20 




-36 


12 


9 


-19 






-3 






21 


33 






84 
















-19 




-15 






-7 


-41 










Acuity (vs. level 3)J 




























Level 2 




23 












16 


30 














-20 


-175 


-436 


-73 


-177 


-293 


-39 


-109 


-179 


-36 


-117 


-196 


Crowding 




























ED occupancy (10% 


increase) 










3 


9 


-2 






1 


2 




Medicine bed (10% 


ncrease) 






12 








-3 




17 




2 




*Nonsignificant estim 


tes (p > 0.05) 


are shown by 




(-). 




















tOther covariates in e 


ach regression 


model included time 


of day, day 


of week 


and interaction of chi 


3f com 




acuity. 




{Acuity level 1 patients not included 


in this model 

























Figure 2). The largest difference in waiting room time 
by acuity level was observed at approximately 6:00 pm. 
There is little temporal variation in median waiting 
room time for acuity level 1 patients. However, the 
waiting room time of acuity level 2 patients varied 
significantly by day of week and time of day at all sites 
except site B. Acuity level 3 patients waited the longest 
across the four sites, and their waiting room times were 
most influenced by temporal factors compared to other 
acuity level patients. The waiting room times at sites B 
and C were much shorter on the weekends compared 
to the weekdays and varied much less by acuity com- 
pared to during weekdays. 

Table 3 illustrates the strong effect that the clinical 
factors had on treatment time compared to patient or 
crowding factors. In general, patients who presented 
with an acuity level 3 general symptom complaint 
waited longer than most others, except for patients 
with digestive complaints (50th percentile range 35 to 
63 minutes) or psychiatric complaints (50th percentile 
range 14 to 122 minutes). Across all of the sites, acuity 
level 4 and 5 patients (50th percentile range -109 to - 
177 minutes) were treated faster than acuity level 3 
patients. There was also a strong interaction effect 
between chief complaint and acuity level (see Table 4). 
At all study sites, skin, injury, and respiratory problems 
were associated with the shortest median treatment 
times for acuity level 2 and 3 patients. Patients who 



presented with psychiatric complaints such as suicide 
ideation, depression, or alcohol abuse had the longest 
treatment times, regardless of acuity level. For acuity 
level 2-5 patients, the 90th percentile treatment times 
were two to five times greater than the 50th percentile 
treatment times depending on the specific chief com- 
plaint, acuity level, and site. 

Patient, clinical, and crowding factors had a modest 
influence on boarding time (see Table 5). The most 
consistent effect on boarding time at all of the 
sites and percentile distributions were the crowding 
factors. A 10% increase in the inpatient medicine bed 
occupancy rate (at the 50th percentile range is 13 to 
58 minutes) resulted in a longer boarding time com- 
pared to the same increase in the ED occupancy rate 
(at the 50th percentile range is 3 to 14 minutes). Both 
crowding factors had larger effects on the right tail of 
the boarding time distribution. 

Figure 3 displays the observed and predicted 10th, 
50th, and 90th percentile waiting room times, treatment 
times, and boarding times at all four sites. The waiting 
room time at the 90th percentile ranged between 
15 minutes and 4 hours depending on the time of day, 
day of week, and site. In addition to the strong 
influence of temporal factors on waiting room time, 
Figure 3 also shows that time of day and day of week 
influence treatment time and boarding time (to a lesser 
degree than waiting room time). At site C, the 90th 
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Table 4 

Adjusted 10th, 50th, and 90th Percentiles of Treatment Time by Acuity Level and Chief Complaint* 
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Acuity level 2 


n 


= 11,394 






n = 18,409 






n = 19,342 






n = 5,369 




Respiratory 


47 


177 


615 


71 


181 


480 


67 


194 


471 


27 


162 


359 


sjMr ory 


52 


194 


508 


58 


194 


451 


45 


184 


461 


18 


157 


345 




























General 


47 


207 


617 


87 


212 


486 


79 


220 


590 


38 


181 


416 




























Ca rdio vascuta ^ ™ 


37 


176 


624 


82 


268 


1305 


83 


238 


828 


34 


170 


388 


Musculoskeletal 


67 


225 


609 


97 


242 


613 


82 


212 


493 


63 


202 


402 


Genitourinary 


66 


223 


486 


118 


249 


475 


104 


239 


498 


48 


236 


418 




























Psychiatric 


64 


310 


877 


117 


342 


657 


103 


327 


702 


39 


196 


592 


Acuity level 3 




= 26,908 






n = 27,186 






n = 20,684 






n = 24,323 




Skin 


21 


188 


957 


66 


208 


820 


43 


106 


333 


44 


135 


332 




18 


145 


456 


71 


213 


534 


56 


145 


336 


76 


171 


345 


Respiratory 




























23 


192 




72 


224 


586 




149 


380 


72 


180 


391 


Nervous/eye/ears 


22 


196 


540 


81 


237 


525 


56 


185 


433 


80 


201 


400 


Genitourinary 


36 


208 


530 


90 


246 


512 


83 


196 


423 


67 


195 


388 
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Cardiovascular 


22 


206 


695 


106 


271 


1121 


\ 


202 


531 


91 


224 


423 


Diqestive 


35 


253 


758 


116 


305 


643 


90 


243 


520 


92 


254 


513 




























Acuity level 4-5 


n 


= 13,846 






n = 8,017 






n = 7,449 






n = 28,586 




General 


4 


35 


221 


14 


65 


262 


24 


81 


280 


40 


98 


239 


Skin 


8 


45 


274 


27 


80 


255 


25 


75 


205 


45 


100 


206 


N e rvo us/eye/ea rs 


6 


43 


156 


35 


90 


260 


27 


80 


268 


44 


99 


219 




6 


35 


213 


25 




259 


28 


91 


329 


48 


120 


322 




7 


47 


176 


32 


86 


245 


32 




229 


54 


113 


220 


Respiratory 


8 


47 


191 


32 


89 


238 


37 


92 


243 


48 


113 


244 


Musculoskeletal 


9 


53 


209 


38 




274 


40 


100 


240 


55 


117 


236 


Genitourinary 


9 


53 


188 


34 


106 


317 


38 


104 


282 


49 


112 


270 


Cardiovascular 


10 


51 


281 


57 


182 


399 


63 


134 


390 


56 


133 


276 




8 


87 


559 


80 


344 


723 


53 


196 


557 


75 


244 


465 



QR = quantile regression. 

*Adjusted times were calculated for patients who were 40 years old, were male, walked in, had commercial insurance, and 
arrived at Saturday midnight when the ED occupancy rate was 100% and the inpatient medicine bed occupancy rate was 85% 
using multivariate QR. 



percentile boarding times were much longer during the 
week compared to weekends. 

Figure 3 also demonstrates close agreement between 
the observed and predicted 10th, 50th, and 90th per- 
centile waiting room time, treatment time, and board- 
ing time distributions. Further evidence of the 
accuracy of the models is displayed in Table 6 by 
the proportion of predicted estimates that fell within 
the 10th, 50th, and 90th percentile distributions for the 
different phases of emergency care. At each site and 
acuity level, the estimates from the QR models fell 
within 1% to 2% of the observed 10th, 50th, and 90th 
percentile distributions. 

DISCUSSION 



It is well recognized that perceptions of a service orga- 
nization are significantly affected by how well it per- 
forms not only for typical customers but also for those 
at the extremes. This study demonstrates that QR is a 
useful method for characterizing the typical LOS expe- 



rience, as well as at both ends of the LOS distribution. 
At all of the study EDs, we observed large variability in 
ED service completion times. Waiting room time was 
largely determined by day of week, time of day, and 
acuity level. In contrast, the strongest predictors of 
treatment time were acuity level and chief complaint. 
Temporal factors also influenced boarding time. With 
the exception of mode of arrival, patient characteristics 
had minimal influence on ED service completion times. 
The influence of some of the factors varied significantly 
across the percentile distributions. Our data suggest 
that EDs across the country could use QR to more fully 
understand how the efficiency of ED care varies and to 
identify factors whose effects may not be constant 
across the service completion time distributions. 

Quantile regression is appropriate when the predic- 
tor variables may affect the outcome differently at dif- 
ferent parts of the distribution. The ED service 
completion distributions at all of the study sites were 
highly skewed, with long right tails. The difference in 
the time between the 10th percentile and the 50th 
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Table 5 

Change (Minutes) Associated With Patient, Clinical, and Crowding Factors on the 10th, 50th, and 90th Percentiles of Boarding Time* 

Site A Site B Site C Site D 

(n = 13,558) (n= 16,349) {n = 13,737) (n = 6,506) 

Variables in Modelt 10% 50% 90% 10% 50% 90% 10% 50% 90% 10% 50% 90% 

Intercept 73 193 431 61 154 450 56 250 870 113 257 506 
Patient 

Age (10-year increase) 3 3— — 291 4 — 88 15 

Female (vs. male) — — — 3 — — — — — — 9 — 

lnsurance(vs. commercial) 

Medicaid 8 14 37 — 11 — — 18 76 — 39 72 

Medicare — 13 — 5 — — — 19 41 20 21 — 

Self-pay — ___ ___ u — — — 21 

Ambulance arrival (vs. not ambulance) — — — -6 — — — -30 -54 — — 33 
Clinical 

Chief complaint (vs. general) 

Injury — — — — — — -15 -56 -281 — — — 

Digestive — ___ ___ _ __-|5_ _ 

Cardiovascular -49 -33 -53 — — — — -33 — 20 — -85 

Psychiatric — — — — — — — — — -29 -37 -60 

Nervous/eye/ears — — — — — — — — — — — — 

Respiratory — — — 10 ___ _ _ 28 — — 

Genitourinary — -24 — — — — — — -173 -67 -75 -113 

Skin ________ _1 ___ 

Musculoskeletal — — — — — — — — — — — — 

Acuity level 2 (vs. level 3-5) t -11 -16 — — 15 16 — — -71 5-3 6 
Crowding 

ED occupancy (10% increase) 2 3 9 1 6 25 1 14 48 1 3 6 

Medicine bed (10% increase) — 13 44 8 29 107 4 58 130 11 25 54 

•Nonsignificant estimates (p > 0.05) are shown by a dash ( — ). 

tOther covariates in each regression model included time of day, day of week, and interaction of chief complaint x acuity. 
{Acuity level 1 patients not included in this model. 



12 0 12 0 12 0 12 0 12 0 12 0 12 0 0 12 0 12 0 12 0 12 0 12 0 12 0 12 0 
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Figure 3. Observed (blue lines) and predicted (red lines) 10th, 50th, and 90th percentiles (in hours) of waiting r 
treatment time, and boarding time by day of week, hour of day, and site. 



n of Estimates That Fell Below the 10th, 50th, and 90th Percentile Distributions by Acuity Level and Site 



n = 54,847 

0.098 0.497 
0.098 0.504 
0.103 0.505 
0.099 0.495 
n = 54,847 

0.102 0.499 0.897 

0.104 0.495 0.903 

0.098 0.499 0.899 

0.099 0.502 0.901 
n = 13,558 

0.097 0.497 0.904 

0.102 0.504 0.902 

0.100 0.503 0.900 



0.098 0.496 
0.104 0.504 
0.096 0.500 
n = 53,980 

0.100 0.497 
0.103 0.503 
0.099 0.501 
n = 16,349 



0.103 
0.103 
0.095 
0.096 



0.500 
0.500 

=58,316 



0.104 
0.104 
0.095 
0.101 



0.498 
0.495 
0.499 
0.506 
: 13,737 



0.904 
0.904 
0.905 



0.103 
0.098 
0.103 



0.504 
0.496 
0.495 
= 6,506 



0.099 
0.102 
0.100 



0.501 
0.499 
0.503 



0.895 
0.901 
0.905 



LOS = length of stay. 



percentile was much smaller than the difference 
between the 50th and 90th percentile. Many patients 
are waiting much longer than the average or the 
median. High performing service industries set their 



delivery targets at the 90th percentile or higher, not at 
the median. 11 In the ED setting, we need to focus not 
only on the middle of the distribution, but also on 
extreme events, especially for patients with long 
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waiting room and/or boarding times, because these 
phases represent little value to patients. 

The influence of some factors on ED service comple- 
tion time varied substantially across the distribution. 
For example, at site A, at the median of the distribution 
of waiting room time, patients with psychiatric com- 
plaints waited 11 minutes less compared to patients 
with general symptom complaints. However, at the 
90th percentile, psychiatric patients waited 48 minutes 
longer than patients with general symptom complaints. 
This site needs to determine why the disparity does not 
exist at the center of the distribution, but does exist at 
the right tail. Similarly, at site C, the boarding times of 
patients with injuries are significantly less at the 90th 
percentile compared to the 10th percentile. Site C could 
investigate why injury is more influential at the 90th 
percentile compared to the 10th. 

In this study, temporal factors (i.e., time of day and day 
of week) were important predictors of waiting room time 
and boarding time. To a large extent, they are important 
predictors because they are surrogate measures of the 
demand for ED and inpatient services and the resources 
available to meet the demand. Demand for ED services, 
as measured by the ED arrival rate, is highest in the late 
morning and afternoon hours and lowest at night and in 
the early morning hours. 12,13 The ED arrival rate also 
varies by day of week. Depending on staffing and ED 
capacity, ED waiting room times will closely mirror the 
ED arrival rate pattern with a modest lag unless there is 
a boarding problem, which will also independently influ- 
ence the waiting room time distribution. 2 Likewise, 
boarding times also vary by time of day and day of week 
because the demand for inpatient beds by ED patients 
and patients from other venues peaks at predictable 
times of the day and days of the week. The crowding fac- 
tors that we included in the models had a modest effect 
on waiting room time and boarding time after control- 
ling for time of day and day of week. This was expected 
given the colinearity between the crowding measures 
and the temporal factors. 

We also observed that the effect of temporal factors 
on ED waiting room time varied significantly by acuity 
level. This interaction effect is not surprising given that 
EDs prioritize and organize the delivery of emergency 
care according to triage level. For acuity level 1 patients 
who presented with life-threatening conditions, there 
was no significant variation in ED waiting room time 
by time of day or day of week at the study sites. For 
acuity level 2 and 3 patients, who are considered to 
have emergent and urgent problems, respectively, the 
variation in waiting room time by temporal factors var- 
ied by order of magnitude (temporal variation was 
much greater for acuity level 3 vs. 2 patients). The non- 
urgent patients (i.e., acuity levels 4 and 5) had shorter 
wait times than acuity level 3 patients, because patients 
who presented with nonurgent problems were seen in 
the "urgent care" or "fast track" areas of the study 
EDs. Acuity level 3 patients waited the longest at all 
four study sites because they were assigned the lowest 
level of priority among the patients treated in the main 
area of the ED. 

Clinical factors, that is, acuity and chief complaint, 
were also significant predictors of ED LOS, particularly 



ED treatment time. Asaro and colleagues 1 also found 
that acuity level and chief complaint were the most 
important determinants of ED and fast track treatment 
times. To the best of our knowledge, this is the first 
study to identify a significant interaction effect between 
acuity level and chief complaint on ED service comple- 
tion times. For ED treatment time, the variation in ser- 
vice completion time by acuity level for a specific chief 
complaint is most likely due to the differences in testing 
and treatment required depending on the urgency and 
complexity of the condition. 

There was considerable variation in service comple- 
tion times across the sites. Some of the variation is 
likely due to organizational differences among the sites. 
For example, site C has the shortest waiting room time 
of all the sites, most likely because it has the largest 
treatment capacity (9 to 15 more treatment spaces in 
the main ED than the other EDs). The 90th percentile 
treatment times at sites A and B were considerably 
longer than the other two sites; however, these two 
sites have observation units, and the care patients 
received in the ED observation units was included in 
the treatment times reported in this analysis. The 
reasons for other variations in service completion times 
are less clear. For example, each of the study EDs has a 
fast track, yet there was large variation in the waiting 
room time and treatment time of patients who pre- 
sented with nonurgent problems (i.e., acuity level 4 and 
5) across the sites. Examining differences in outcome 
by site and identifying best practices is a fruitful area of 
future research. 

LIMITATIONS 



The results of this study must be considered in the con- 
text of the following limitations. First, we used separate 
models to estimate the different phases of emergency 
care. We did not attempt to predict total ED LOS. Pre- 
dicting total ED LOS is more challenging because it 
requires accurately predicting the probability of admis- 
sion and modifying the service completion estimates by 
the probability of admission. Second, these models pro- 
vide estimates of service completion times at the time 
of triage. We have not yet incorporated into the models 
the effect of ordering different tests or specific test 
results, services requested, or procedures rendered on 
estimates of the service completion times. 1,14 As care is 
delivered to ED patients, service completion estimates 
could be updated based on the effect of different evalu- 
ation and treatment activities and provided to patients 
during the course of their ED visit. 

A third limitation is that the sample size was too 
small to develop comprehensive models for acuity level 
1 patients; however, they are the least likely to need 
service completion estimates because their care is typi- 
cally expedited by the severity of their illness or injury. 
Fourth, we only had a single year of data from each 
site, limiting our ability to estimate the effect of season- 
ality on the ED service completion times. However, this 
could easily be estimated by using ED visit data from 
multiple years. In addition, with more data, we could 
have made more clinically distinct groups out of the 10 
general chief complaint categories and estimated the 
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service completion times with more precision. Fifth, we 
did not verify the accuracy of the electronic data, but 
some of the data are time stamped automatically, such 
as registration time and decision time to admit. Further, 
all of the study sites depend on these data to monitor 
operations, so they are being reviewed and checked 
regularly. 

Finally, all of the sites are academic EDs; there were 
no community hospital EDs included in the study. None 
of the EDs consistently met industry standards for all 
phases of emergency care. Regardless of how fast or 
slow a particular phase of care was completed at the 
four different EDs, QR proved to be a robust method 
for predicting ED service completion times. The results 
suggest that the overall approach should generalize 
well to other EDs, and the models can be customized to 
reflect any unique influences that different factors have 
on service delivery at a specific ED. 

CONCLUSIONS 

Quantile regression proved to be a useful method for 
characterizing the service completion experience of 
not only typical ED patients, but also of patients who 
waited much shorter or longer times. In this study, 
quantile regression illustrated how highly variable 
the length of stay experience is among ED patients 
at four academic centers. Building accurate models 
of ED service completion times is a critical first 
step needed to identify barriers to patient flow, begin 
the process of reengineering the system to reduce 
variability, and improve the timeliness of care pro- 
vided. 
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